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Creating On Content Enhancements 

Cross Reference to Related Applications 

This application is based upon and claims priority to United States provisional 
application 60/243,107 entitled "CREATING *ON-CONTENT' ENHANCEMENTS" 
filed October 24, 2000 by Gary Rasmussen, Steven O. Markel, Ian Zenoni, Steven 
Reynolds, and Thomas Huber, United States provisional appUcation serial number 
60/309,714 entitled "POST PRODUCTION VISUAL ALTERATIONS" filed August 2, 
2001 by Thomas Lemmons, and United States non-provisional application 09/935,492 
entitled "SYSTEM AND METHOD FOR WEB BASED ENHANCED INTERACTIVE 
TELEVISION CONTENT PAGE LAYOUT" filed August 21, 2001 by Steven 0. 
Markel. The entire disclosure of each of these apphcations is additionally specifically 
incorporated herein by reference for all that they disclose and teach. 

Background of the Invention 

a. Field of the Invention 

The present invention pertains generally to interactive television and specifically 
to interactive enhancements that are located on the video image. 

b. Description of the Backgroxmd 

In the prior art, a viewer subscribing to enhanced content video and choosing to 
view enhanced and interactive television content typically will see the standard video 
presentation shrunk down to 2/3 size and have the remainder of the screen available for 
the enhancements. Such enhancements may be buttons that the viewer may select to 
display additional content, advertisements and offers for sale for various products, textual 
or graphical displays that augment the main video program, or other interactive content. 

The shrinking of the video presentation has several detrimental effects on the 
viewer. The viewer does not fiiUy enjoy the video presentation since the size of the 
screen is minimized. The viewer's eyes, rather than being fixated on the video 
presentation, may be distracted by the interactive content. The interactive content may 
change during the video presentation, which further distracts the viewer. 
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It would be valuable to provide an interactive access point, i.e., an on content 
enhancement point such as a 'hot spot' and a system and method for generating a hot spot 
that is both easy to use and can be located on the streaming content. 

Summary of the Invention 

The present invention overcomes the disadvantages and limitations of the prior ^ 
by providing a simple and easy to use apphcation that can quickly create a hot spot on a 
video image. Further, the present invention allows an author to create hot spot definitions 
that maybe translated into several different formats for final viewing. 

The present invention may therefore comprise a method of creating links to 
enhanced content on a video stream comprising the steps of: enabling a user to halt the 
video stream so at to provide a single video frame or "screenshot" for viewing; 
overlaying a portion of the screenshot with a geometric outline to identify a hot spot on 
the screenshot; assigning enhancement attributes to the hot spot; storing the hot spot and 
the attributes in a generic format; translating the hot spot and the attributes from the 
generic format into a first format; and embedding the hot spot and the attributes in the 
first fomiat into a video stream. 

The present invention may further comprise a method of creating links to 
enhanced content on a video stream using a template comprising the steps of: creating a 
template that defines at least one attribute for a hot spot; enabling a user to halt the video 
stream so at to provide a single video frame or ''screenshot" for viewing; overlaying a 
portion of the screenshot with a geometric outline to identify a hot spot on the screenshot; 
assigning at least one attribute to the hot spot based on the template; and embedding the 
hot spot and the attributes in the specific format into a video stream. 

The present invention may further comprise a method of creating customized 
links to enhanced content on a video stream using a template comprising the steps of: 
creating a template that defines at least one attribute for a hot spot; enabling a user to halt 
said video stream so at to provide a single video frame or "screenshof for viewing; 
overlaying a portion of the screenshot with a geometric outline to identify a hot spot on 
the screenshot; assigning at least one attribute to the hot spot based on the template; 
storing the hot spot and the attributes in a generic format; translating the hot spot and the 
attributes from the generic format into a first format, said translating being done with the 
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template; and embedding the hot spot and the attributes in the first format into a video 
stream. 

The present invention may further comprise a method of Unking and using 
enhanced content on a video stream comprising the steps of: enabhng a user to halt the 
5 video stream so at to provide a single video frame or "screenshot" for viewing; 

overlaying a portion of the screenshot with a geometric outline to identify a hot spot on 
the screenshot; assigning enhancement attributes to the hot spot; storing the hot spot and 
the attributes in a generic format; translating the hot spot and the attributes from the 
generic format into a first format; embedding the hot spot and the attributes in the first 
10 format into a video stream; displaying the hot spot using a first set top box on a video 
screen; and allowing a viewer to access the hot spot whereby the viewer may access the 
enhanced content. 

p The advantages of the present invention are that the enhancements may be reused 

!^^^' for several applications without redoing an extensive amount of work. The 

05 15 enhancements may be formatted for different hardware platforms, different languages, 

yj. ) 

tL and a different look and feel without any manual editing of the actual hot spots. Further, 
f the use of predefined formats allows the author to create consistent looking enhancements 

Q quickly and easily. 




Brief Description of the Drawings 



In the drawings, 

FIGURE 1 is an illustration of a television screen showing a news clip. 
FIGURE 2 is an illustration of the news clip of FIGURE 1 with hot spots overlaid 
thereupon. 

25 FIGURE 3 is a work flow diagram of an embodiment of the present invention 

wherein a person may create on-content enhancements to a video signal. 

FIGURE 4 is a flow chart of the overall sequence of an embodiment of the 
present invention. 

FIGURE 5 is a flow chart of the hot spot creation sequence of the embodiment of 
30 FIGURE 4. 
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FIGURE 6 is a flow chart of the preview sequence of the embodiment of FIGURE 

4. 

FIGURE 7 is a flow chart of the publication sequence of the embodiment of 
FIGURE 4. 

FIGURE 8 illustrates a block diagram of a set top box. 

Detailed Description of the Invention 

Figure 1 illustrates a video image 100 depicting a television news clip. The news 
clip is depicting a press conference announcing a tire recall, with one gentleman 102 
speaking at a podium, another gentleman 104 seated, and a picture of a tire 106 on an 
easel. The image is a news feed from a camera at a press conference and is typical of the 
images used in national nightly news programs. 

Figure 2 illustrates a video image 200, which is the image of Figure 1 with hot 
spots overlaid thereupon. The gentleman speaking at the podium is defined with hot spot 
202, the seated gentleman is defined by hot spot 204, and the tire is defined by hot spot 
206. 

Hot spots may be embedded commands in the video broadcast that are read by a 
set top box, which may take the commands, create the hot spot, display the hot spot 
overlaid on the video signal, accept input from the user, and transmit data to a remote 
sever. 

The hot spots 202, 204, and 206 may be geometric shapes that are placed over the 
streaming media. Hot spots 202 and 204 are shown as rectangular outlines that identify 
the two persons. Hot spot 206 is a hot spot defined by an eight-sided polygon. Hot spots 
202 and 204 define areas that each include a head of a gentleman in the picture, but do 
not closely map the gentlemen's profiles. Hot spot 206 closely, but not exactly, matches 
the outline of the tire. The hot spots need only be precise enough to help the user 
determine what object or portion of the screen is related to the interactive content. For 
example, hot spot 202 may be linked to a short biography of the gentleman. 

In other embodiments, hot spots may be shaped to closely follow the contour of a 
particular person or object in a video presentation. Such an embodiment may be 
particularly useful if many hot spots were to be presented. In yet another embodiment, a 
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hot spot may be constructed to cover the entire display. Further, a hot spot may be 
constructed to include the entire screen and then other hot spots may be constructed over 
only certain areas of the screen. 

Hot spots may be substantially larger than the items that the hot spots track. For 
5 example, the hot spot 202 refers to the standing gentleman's head, but the hot spot is 
almost 100% larger in area than the gentleman's head, hi some cases, such as where the 
item is very small on the screen, a hot spot may be several times larger than the area of 
the item to which it refers, hi other cases, the hot spot may be a single icon or spot of a 
significant color. When the viewer moves a cursor near the spot, the hot spot may 
10 become active. 

The viewer may select a hot spot by moving a cursor over the hot spot and 

^! selecting the hot spot. The cursor may be moved with a keypad, mouse, joystick, 

C-l ■ 

O gyroscopic pointing device, or other device adapted to move a cursor on a television 

screen. In some cases, the hot spots may be selected by tabbing through the hot spots 
CI 15 with a single key. As the hot spot is selected, an action associated with the hot spot may 

be performed. The selection of the hot spot may be to have the viewer press a button, 
^ issue a verbal or audible command such as speaking or clapping, or otherwise provide 
C J input to activate the hot spot. In some instances, merely placing the cursor on the hot 

if; I 

ii spot may cause an action, such as illuminating the hot spot or providing a text descriptor 
20 for the hot spot. In other instances, selecting the hot spot may display a menu of choices 
for the actions associated with the hot spot. 

In some embodiments, the outline of the hot spot areas may be visible to the 
\dewer. The hot spot borders may be different colors or have different visual and 
graphical features. The colors of each border may correspond with a button on an input 
25 device, such as a remote control or keyboard, or may be used to indicate certain 

parameters regarding the interactive content. Other features, such as a border aroimd the 
hot spot, the thickness of the border, a blinking, pulsating, or change in intensity of the 
border, a graying out of the actual object defined by the hot spot, or other visual cues may 
be used to further indicate certain parameters. Additionally, icons or other graphical 
30 elements may be used to indicate certain parameters. Such parameters may be the action 
associated with the hot spot, the type of content associated with the hot spot, the length or 
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detail of the interactive content, whether the item highhghted is offered for sale or a 
special promotion is offered for that item, the importance of the content with respect to 
the story, the length of time that the hot spot will remain active, the source of the 
interactive content, or other parameters as may be desired. 
5 For example, a hot spot with a small text icon may cause a small window to be 

created over a portion of the display and display a short biography of a person, or a hot 
spot with a camera icon cause a replay of a scene that was shown previously. In another 
example, a red hot spot may cause the audio track to mute and have another audio clip 
played. In another example, a hot spot with a flashing border may cause data to be sent 
10 back to a server for aggregation, such as a vote to be taUied for or against a certain 
l^k participant in a game show. In another example, a green hot spot may cause a product 
p| purchase to be initiated. In another example, a grayed out hot spot may cause a text 
45 description of an obj ect to be sent to the display on the person' s remote control via 
'fr% infrared or wireless link. In yet another example, a hot spot with an email icon may 
J-f 15 cause an email coupon, description, or a special promotional web link to be sent to the 
i viewer's email address. 

p In some embodiments, the hot spots may be tailored to an individual's buying 

habits and interests. For example, hot spots may be available to a viewer whose 

CI preference for alcoholic beverages is known and not made available to a viewer who's 
20 distaste for alcohol is also known. The choice of the availabihty of hot spots may be 
done by the viewer himself or by the distributor of the interactive media. For example, 
an advertiser who pays for the hot spot Unk may only pay to target their specific 
audience, such as beer drinking males fi-om 25 to 35 years of age. In this case, the 
distributor of the media may only make the advertiser's hot spots available to viewers in 
25 a specific demographic segment. In another embodiment, the viewer may program a set 
top box to allow or disallow certain hot spots. For example, a viewer may disallow hot 
spots relating to pomographic links or links to purchase items. The viewer may be able 
to use a menu system on the set top box to activate or deactivate specific interactive 
content. Further, the viewer may choose to pay extra to have certain interactive features 
30 activated or deactivated. For example, the viewer may pay an extra amoxmt of money 
each month to have textual descriptors and reference material available through hot spots. 
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In another example, the viewer may pay extra money to have unwanted advertisements 
removed from the interactive content of the shows broadcast to the viewer. 

When enhanced and interactive video hot spots are available for a particular 
scene, a special small icon, such as the 'Buycon TM' image used by Intellocity USA, 
5 Inc., may appear in a comer of the screen. CUcking on the icon may momentarily present 
a heads up display (HUD) that draws a border around each hot spot in the scene. Along 
with the borders, the HUD could also display a brief product or advertising information. 

One aspect of the present invention is directed to providing the viewer with 
information. Suppose that the viewer was watching the program of a tire recall depicted 
10 in Figure 2. Ifthe viewer clicked on the hot spot 206 located on the tire, a small window 
may be presented that may detail which cars had this tire factory installed, where to get 
2 the tire replaced, and an email or web address for more information. The hot spot 206 
0 may also have the information necessary to transmit data to handheld receiving devices. 
Each device may display the information, such as news, pricing, etc. M such an 

0^ 15 embodiment, several people in a household, each watching the same program at the same 

CI".. 

time and having different handheld receiving device, may act upon different hot spots and 

each get their relevant information. 
11 Another aspect of the present invention is directed to providing interactive 

advertising that permits a viewer to order a product or service that is actually depicted in 
H 20 the video program. Instead of a news program, the viewer may be watching a comedy 

show having a scene where the actors and actresses are all sitting around talking and 

eating pizza. The viewer may press a button on their pointing device or remote control to 

highUght any hot spots that may be available for the particular scene. If the pizza box 

sitting on the coffee table became enhanced indicating it was a hot spot, a viewer may 
25 cUck or move the pointing device over the pizza box and thereby initiate ordering a pizza 

themselves, or request that a coupon be emailed, entitling the viewer to a reduced price 

for the pizza or other item advertised. 

In still another aspect of the invention, rather than ordering a product or service 

by clicking on it in a scene, the viewer may also customize the advertising to be delivered 
30 during the periodic commercial breaks. With this approach, rather than having to view 
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advertisements for unwanted products, the advertisements may be tailored to the viewer's 
interests and selections delivered during the commercial breaks. 

Additionally, the present invention may be used in connection with political 
conventions or with any of the courtroom or ^reality' programming shows or the Uke, 
such that onUne polls could be estabUshed so that by selecting a candidate or participant 
during the convention or show, viewers could cast their vote for a particular candidate or 
participant in accord with what is being viewed. 

In some embodiments, activating a hot spot may cause the screen to be changed 
into the traditional interactive enhancements with the reduced screen size and an L- 
shaped region with interactive content. Such an arrangement may be advantageous in 
some circumstances, such as when several options for a hot spot are available and the 
viewer is offered a menu of choices through the L-shaped region of the screen rather than 
have such choices be overlaid onto the video image. 

hi some embodiments, the viewer may have the option to turn off the hot spots 
from the display. The user may do this by selecting a button on the remote control, or the 
interactive content may be suppressed until the user makes a request for interactive 
content. An embodiment may begin showing an interactively enhanced television show 
and display a small icon in a specific area of the screen, indicating the presence of 
interactive content. The user would then use an interactive device, such as a remote 
control, to display the interactive elements on the screen and select one as desired, hi 
other embodiments, the viewer may be charged a fee for having the hot spots active and 
allowing the viewer to enjoy the enhanced content, ha other embodiments, the viewer 
may elect to pay a fee to have enhancements, for example, those advertising products, to 
be deactivated and not shown, 

hi other embodiments, the hot spot borders may illuminate briefly when the hot 
spot is activated then disappear from the screen. The viewer may still select the hot spot 
even though the hot spot is not visible on the screen. The cursor, for example, may 
change to indicate that the viewer has moved over a hot spot with interactive content, hi 
some embodiments, when the viewer moves a cursor over a hot spot, called a mouseOver 
event, the hot spot border may illuminate or some other graphical representation, hi 
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some embodiments, a small text box may appear giving the name of the person in the hot 
spot or the description of the interactive content 

The shape of the hot spot may be used to more clearly identify what kind of 
information may be linked to the hot spot and may not be necessarily linked to a specific 
5 object on the screen. For example, a hot spot with a specific shape, such as a * Y' or 'N' 
may be selected in response to a particular query, such as a confirmation of an order. The 
shape of the hot spot may correspond with a particular button on an input device. For 
example, the shape of hot spot 202 may be changed to an outline of the letter 'A', 
indicating that pressing the button labeled 'A' on an input device would activate that 
10 particular hot spot. In the example, an outline of a letter 'A' would be placed over the 
gentleman's face, maybe with a faint outline or other non-distracting method. 
^ The hot spots may be completely transparent to the viewer and thereby cannot be 

CI seen by the viewer. In other embodiments, the hot spots may be shovm as outlines, 
E grayed out areas, different colored areas, hatched areas, a dim pulsating border, or other 
|| 15 methods of showing the viewer that interactive content is available. In some 
fcl embodiments, the hot spots may only become visible when the user places the cursor 
1^1^ over the hot spot, also known as a mouseOver event. In some embodiments, the user 
p may have the abiUty to tum on and off the display of the hot spots. For example, a 
ji viewer may elect to have the hot spots tumed off so as not to distract firom a video 
J'f 20 presentation. However, a small icon may be located in a comer or some other non- 
distracting position to indicate that interactive content is available. When the icon is 
available, the user may need to press a button or take some other action to make the hot 
spots visible. 

The hot spot may be overlaid on top of the media so that an area of the screen 
25 does not have to be dedicated to displaying the availabiUty of interactive content, which 
can be distracting to the enjoyment of the video presentation. Further, the hot spot does 
not have to even be seen by the viewer to be active and ready to present interactive 
content. In this manner, the viewer may fully enjoy the video presentation and still have 
all of the benefits of the interactive content. The viewer may move a cursor over the 
30 screen to find interactive content, or the viewer may have the ability to display the hot 
spot outlines on the screen on conmiand. As the viewer becomes more familiar with the 
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Style and types of interactive content on a program, such as a broadcast football game, the 
viewer may not elect to have the hot spots illuminated and the viewer may be able to find 
the interactive content by hunting for the appropriate area of the screen for a hot spot. 

Figure 3 illustrates a work flow diagram of an embodiment 300 of the present 
invention wherein a person (the 'author') may create and test hot spots interactively in a 
what you see is what you get (WYSIWYG) graphical user interface. The author selects 
the video source and assigns project related variables and attributes in block 302. The 
author may position and play the video image in block 304. When the author finds a 
region for a hot spot, the author hits pause and defines the geometric region on the screen 
in block 306. When the author releases the mouse, he is offered the opportunity to assign 
attributes to the hot spot in block 308, If another hot spot is to be created, the author has 
the ability to define additional hot spots at that point in the video by moving back to 
block 306. The author then positions the video to the place where the hot spot is to be 
removed and defines the end point in block 310. The author may play the video to 
another point and continue to add hot spots. Additionally, the author may wish to 
preview the video program with the enhancements activated in block 312. When the 
author is satisfied with the hot spots, the hot spots and attributes may be pubUshed into 
the final code in block 312, The author may begin a different video program in 302 and 
begin the cycle anew. 

The selection of the video is done in block 302. Here, the author may assign 
attributes to the enhancement, such as any standardized styles or look and feel elements 
of the hot spots. Such styles may comprise a specific color, border width, or appearance 
elements that are common or default for the particular program being enhanced. In 
addition, defaults for behaviors of the hot spots may be defined, such as default links for 
the hot spots, how overlapping hot spots are to be treated, when the hot spots become 
illimiinated, if at all, and other variables relating to the hot spot behavior. Other attributes 
may include the intended use of the video program, such as the specific set top box or set 
of set top boxes that may be used to display the program, the type of program being 
produced, information for interactive television guides, or other types of information. 

The author may position and play the video in block 304. The author may jog the 
video quickly or slowly, forward or backward to select a precise firame of the video. The 
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display for the video may have indications on the screen for the frame number or the time 
of the video from a time marker. 

When the author finds the precise point for a hot spot, the author may pause the 
video and begin to defme the hot spot in block 306. The author may create a geometric 
5 region for the hot spot directly on the screen, using a mouse or other pointing device. 
The author may create a rectangular, circular, or polygon shaped area for the hot spot, hi 
addition, some embodiments may permit the author to defme the hot spot using splines 
and curved sections. The author may be able to adjust and move vertices of the 
geometric areas to precisely move the lines or curves that define the hot spot. 
10 The author may define attributes for tiie hot spot in block 308. The block 308 

may be initiated immediately after the author releases a mouse button v^hen the hot spot 
^ geometry is defined or the author may have to press another button when he is through 

63 manipulating the geometry. The attributes of the hot spot defined in block 308 may be 
iS variables associated with the action of the hot spot, such as a link to a specific web page 
^ 15 or file, a textual description that will be displayed when the hot spot is activated, specific 
§J overrides of the default actions defined in block 302, or other action related variables. Li 
addition, the attributes of the hot spot may relate to the presentation of the hot spot, such 
as color, border width, whether the hot spot is grayed out, pulsating borders, icons 

O ■' 

m associated with the hot spot, or other visual attributes. 

20 The author may elect to create another hot spot at the current point in the video 

H program, and in so doing would retum to block 306. 

When the author has defined all of the hot spots at the current point of the video, 
the author may position and play the video to the end point of the hot spot in block 310. 
At this point, the author may define the end point ofthe hot spot. If the author has 
25 several hot spots that have defined start points but no end points, the author may be able 
to enter the current position as a stop point or may be able to position and play the video 
to another stop point for each hot spot where no stop point is defined. 

After defining the hot spots, the author may preview the enhanced video with all 
of the hot spots active in block 312. The author may be able to view the video and 
30 actuate each hot spot and evaluate the correct performance of each hot spot. The author 
may be able to review and retry sections of the video to ensure that the author's 
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enhancements are working correctly. If changes need to be made, the author may edit the 
hot spots using blocks 306, 308, and 310. The author may have provisions to position the 
video directly at the frame where a hot spot is first defined so that the author may make 
changes to the hot spot geometry md attributes. In addition, the author may be able to 
5 edit the project attributes firom block 302 at any time during the operation of block 312. 
When the author has completed the hot spot creation, the final results may be 
published into the final code of block 3 14. The final code may be created for one or 
more types of set top boxes. 

Figure 4 is a flow chart of the overall sequence of an embodiment 400 of the 
10 present invention. The process starts in step 402. The project attributes are assigned in 
step 404 and saved to a database in step 406. The video is positioned and played in step 
L-i,. 408 until the author pauses or stops in step 410. If the author pauses the video, he can 

If create hot spots in step 412 on the frame at which he paused. If he stops the video, he has 

O 

JS the option of previewing in step 414. If he previews in step 416, he has the option of 

C 15 making finther changes in step 41 8. When he is satisfied with the preview, he has the 

03 option to publish in step 420, which creates the final code in step 422. The author then 

s has the option of doing another video in step 424 or ending in step 426. 

t.i. 

C Embodiment 400 is a flow chart version of embodiment 300. The sequence of 

M . 

rj events shown in embodiment 400 is a typical use scenario of embodiment 300. 
p 20 When the author assigns project attribxxtes in step 404 and saves the attributes to a 

' database in step 406, the author may be creating a file or database entry in any sort of 
language or file structure. The author is not cognizant of the data structure because the 
autiior only sees the graphical user interface on which he creates, edits, and views the hot 
spots. Throughout the discussion ofembodiment 400, the references to the database may 
25 refer to any sort of data storage and retrieval scheme, including relational databases, a 
text file, XML, or any other scheme. 

Figure 5 is a flow chart of the sequence of step 412 of embodiment 400. The 
process starts in step 502, after the author has selected the frame at which to begin the hot 
spot. The geometry of the hot spot is created in step 504, the attributes assigned in step 
30 506, and a database record is created in step 508 and saved in step 510. If additional hot 
spots are needed at this frsune in step 5 1 2, the process is repeated. If no more hot spots 
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are needed at this frame, the video is positioned in step 514 until the location of the end 
point of the hot spot is reached and is defined in step 516. The end point of the hot spot 
is saved in step 518. If there are still hot spots that need end points in step 520, the 
process is repeated. If not, the process ends in step 522. 

The process 412 follows the process described in blocks 306, 308 and 3 1 0 of 
embodiment 300. Each hot spot may be created at a specific frame, attributes may be 
defined, then the video may be positioned to a second location where the hot spot is to be 
removed from the screen, and the second location may be saved. As the process is 
repeated for each hot spot, a database entry of each hot spot may be created. 

Figure 6 is a flow chart of the sequence of step 416 of embodiment 400. The 
process starts in step 602, after the author has selected to preview the video with the hot 
spots activated. The database is queried in step 604 to retrieve the hot spot information 
and an XML database is created in step 606. An XSL parser in step 608 creates HTML 
and JavaScript code in step 610 that is embedded in step 612 or overlaid onto the video 
signal. The resultant video signal is previewed in a browser in step 614. The process 
ends in step 616. 

The step 416 uses XML and an XSL parser to create an overlay that is combined 
with a video signal. Many other methods are available to those skilled in the art for 
taking the hot spot definitions, found in the database in step 604, and creating the hot 
spots, and displaying the hot spots with provisions so that the author may test the work he 
has completed. The example set forth here is exemplary in nature and is not meant to be 
restrictive in any sense. 

Figure 7 is a flow chart of the sequence of step 420 of embodiment 400, The 
process starts in step 702, after the author has selected to pubUsh the completed 
enhancements. The database is queried in step 704 to retrieve the hot spot information 
and an XML database is created in step 706. Several XSL parsers in steps 708, 710, and 
712 create code for one or more of a WebTV set top box in step 714, a Liberate set top 
box in step 716, and other types of set top boxes in step 718. After the HTML and 
JavaScript code is created, the code is embedded into the video signal in steps 720, 722, 
md 724 and stored for broadcast in steps 726, 728, and 730. The process ends in step 
732. 
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The step 420 uses XML and an XSL parser to create an overlay that is combined 
with a video signal Many other methods are available to those skilled in the art for 
taking the hot spot definitions, found in the database in step 604, and creating the hot 
spots, and displaying the hot spots with provisions so that the author may test the work he 
has completed. The example set forth here is exemplary in nature and is not meant to be 
restrictive in any sense. 

The step 420 may generate code that is specific to different set top boxes, but it 
also allows the author to create code that may be tailored in several other ways. For 
example, a specific XSL parser may create code that is language specific. In the case of a 
soccer game broadcast, an XSL parser may be used to generate code that is tailored for 
viewers fi^om various countries, such as relating the URL links to a country's specific 
websites. The XSL parser may accompUsh this by changing the URLs to a specific 
domain or path that is designated for a specific country, with those URLs being written in 
the home language of the intended audience, hi other instances, the XSL parser may use 
a lookup table or other cross reference to change textual labels for the hot spots to another 
language. In another example, the attributes for the hot spots may include several links 
or other attributes that are set for specific languages and the XSL parser will only use the 
ones applicable for the specific language in which the video will be viewed. 

In another example, an XSL parser may create code that has a specific style or 
behavior of hot spots for certain sets of viewers. In the case of broadcasts for those with 
disabilities, the hot spots may be larger, require only a mouseOver to operate, or have 
other parameters set to accommodate specific users. In some cases, certain broadcasters 
may wish to have a different look and feel of the interactive content. For example, a 
certain cable operator of a specific channel may want to have all of the interactive content 
shown in a certain color, whereas a broadcast network may wish to have a different color. 
In some cases, the fu-st showing of a broadcast may have a certain set of links estabHshed 
for the interactive content and subsequent showings may have a different set of links. 

The author may use a template to aid in creating interactive enhancements that 
have the same look and feel. The template may be an extemally referenced document, 
which would allow the author to concentrate on generating the hot spots and links 
without having to concentrate on the look and feel of the hot spots. When the XSL parser 
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is run, the template may be different for specific applications and result in a different look 
and feel of the interactive content. The templates may also have the ability to set a 
specific domain or path that would serve as a base for all Hnks for the hot spots. The 
XSL parser, by changing the domain or path in the template, may thereby change the 
5 interactive links in a wholesale fashion witiiout having to edit each link. 

The HTML and JavaScript code may be embedded into the video signal by 
storing the code in the vertical blanking interval (VBI) of the video signal. Other 
methods may be employed to store the code in the video signal, depending on the type of 
set top box that is intended to display the video signal. Additionally, coding other than m 
10 HTML and JavaScript may be used depending on the type of set top box that receives the 
video signal. Further, multiple types of encoding and mxiltiple types of code may be 
embedded into a single video signal so that multiple types of set top boxes may each take 
advantage of the enhanced video. 

H Figure 8 illustrates a block diagram of a set top box 800. The broadcast video 802 

m 

m 15 enters the set top box and is parsed by the decoder 804 into the triggers 806 and the video 
N signal808. The processor 810 uses the trigger to create an HTML page 812 that is 
1=1 combined 814 vvith the video signal 808 to create a signal for the television display 816. 
1"! An input device 818 generates a signal to tiie processor 810 which may generate data 820 

5j that is sent back to a server. 

hk 20 The broadcast video 802 may be from any video source, such as an over the air 

broadcast, a cable television channel, a video tape, a DVD disk, or any other video 
source. It may be hve or delayed in broadcast. 

The decoder 804 takes the set top box commands or triggers 806 from the video 
signal 808. The decoder 804 may analyze the VBI of the video and remove commands, 
25 or it may evaluate other portions of the video signal for embedded commands, depending 
on the protocol used by the set top box and the system used to generate any interactive 
content. 

The triggers 806 may include HTML and JavaScript commands and other 
commands and data that may be used by the processor 810. The commands may be of 
30 anylanguageor standard and may not include HTML or JavaScript 
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The processor 810 may be a general-purpose microprocessor or may be specially 
adapted to process specific commands, such as video image generation commands, 
quickly and efficiently. 

The processor 810 may produce an HTML page 812 that is overlaid on the video 
5 signal 808 by combiner 814. The HTML page 812 may be a different type of mark up 
language, descriptor, or other method of defining the image and elements added to the 
video signal 808 to show the interactive content of the enhanced video broadcast. The 
combiner 814 may be a dedicated, specialized electronic hardware device in the set top 
box or may be a software routine executed by processor 810. 
1 0 The input device 818 may be any device that generates a signal that can be 

interpreted by processor 810. Such a device may be a remote control, mouse, joystick, 
keyboard, hygrometer, pointing device, switch, audio input device, video input device, or 
any other device capable of providing a signal that can be interpreted by processor 810. 
The processor 8 1 0 may take the signal from input device 8 1 8 and create data 820 
Wis that is sent to a server. The data may be expressly requested by the viewer to be 
N transmitted such as a request for specific interactive content, communication regarding 
|i the purchase of a product, the input to a form requesting information, or other specific 

P requests by the viewer. The data may also be transparent to the viewer, such as a log of 

PJ-- 

M the viewer's choices in television shows, any monitoring of the environment such as 
2 20 sensing the number of people viewing a program at one time, or other data that the user 
does not specifically request. 

The set top box 800 may be a self contained electronic device that connects 
between the video source and the television 816 or the set top box 800 may be combined 
into another electronic device, such as the television, DVD player, video recorder, or 
25 other device. 

The present invention simplifies and greatly increases the ability of producers of 
interactive television to create programming that maybe seen on various hardware 
platforms. By creating the hot spot information in a generic form, various translators 
make it possible to generate hardware specific programming without any added work by 
30 the author or producer ofthe interactive program. 
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The concept of the translator may be extended to include performing translations 
for different languages, selecting different sets of links to which the hot spots refer, 
changing the look and feel of the interactive program, among other changes that can be 
performed by the translator. 

The present invention allows an author to perform the manual operations of 
selecting the proper frames for a hot spot and generating the geometry of a hot spot with 
a minimum of extraneous work, such as entering attribute data for each hot spot. By 
using a template, the author only needs to enter the specific information that is unique to 
each hot spot, namely the geometry of the hot spot and the link to which it refers. 

The foregoing description of the invention has been presented for purposes of 
illustration and description. It is not intended to be exhaustive or to limit the invention to 
the precise form disclosed, and other modifications and variations may be possible in 
light of the above teachings. The embodiment was chosen and described in order to best 
explain the principles of the invention and its practical apphcation to thereby enable 
others skilled in the art to best utilize the invention in various embodiments and various 
modifications as are suited to the particular use contemplated. It is intended that the 
appended claims be construed to include other altemative embodiments of the invention 
except insofar as limited by the prior art. 
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